Automated Processing of Digitized Historical Newspapers beyond the Article Level: Sections and Regular Features
Identifieur interne : 000743 ( Main/Exploration ); précédent : 000742; suivant : 000744Automated Processing of Digitized Historical Newspapers beyond the Article Level: Sections and Regular Features
Auteurs : B. Allen [États-Unis] ; Catherine Hall [États-Unis]Source :
- Lecture Notes in Computer Science [ 0302-9743 ] ; 2010.
Abstract
Abstract: Millions of pages of historical newspapers have been digitized but in most cases access to these are supported by only basic search services. We are exploring interactive services for these collections which would be useful for supporting access, including automatic categorization of articles. Such categorization is difficult because of the uneven quality of the OCR text, but there are many clues which can be useful for improving the accuracy of the categorization. Here, we describe observations of several historical newspapers to determine the characteristics of sections. We then explore how to automatically identify those sections and how to detect serialized feature articles which are repeated across days and weeks. The goal is not the introduction of new algorithms but the development of practical and robust techniques. For both analyses we find substantial success for some categories and articles, but others prove very difficult.
Url:
DOI: 10.1007/978-3-642-13654-2_11
Affiliations:
Links toward previous steps (curation, corpus...)
- to stream Istex, to step Corpus: 000114
- to stream Istex, to step Curation: 000112
- to stream Istex, to step Checkpoint: 000323
- to stream Main, to step Merge: 000748
- to stream Main, to step Curation: 000743
Le document en format XML
<record><TEI wicri:istexFullTextTei="biblStruct"><teiHeader><fileDesc><titleStmt><title xml:lang="en">Automated Processing of Digitized Historical Newspapers beyond the Article Level: Sections and Regular Features</title><author><name sortKey="Allen, B" sort="Allen, B" uniqKey="Allen B" first="B." last="Allen">B. Allen</name></author><author><name sortKey="Hall, Catherine" sort="Hall, Catherine" uniqKey="Hall C" first="Catherine" last="Hall">Catherine Hall</name></author></titleStmt><publicationStmt><idno type="wicri:source">ISTEX</idno><idno type="RBID">ISTEX:54E3C4788CBEAF0EDBB52BD7A78672CDB1652F13</idno><date when="2010" year="2010">2010</date><idno type="doi">10.1007/978-3-642-13654-2_11</idno><idno type="url">https://api.istex.fr/document/54E3C4788CBEAF0EDBB52BD7A78672CDB1652F13/fulltext/pdf</idno><idno type="wicri:Area/Istex/Corpus">000114</idno><idno type="wicri:Area/Istex/Curation">000112</idno><idno type="wicri:Area/Istex/Checkpoint">000323</idno><idno type="wicri:doubleKey">0302-9743:2010:Allen B:automated:processing:of</idno><idno type="wicri:Area/Main/Merge">000748</idno><idno type="wicri:Area/Main/Curation">000743</idno><idno type="wicri:Area/Main/Exploration">000743</idno></publicationStmt><sourceDesc><biblStruct><analytic><title level="a" type="main" xml:lang="en">Automated Processing of Digitized Historical Newspapers beyond the Article Level: Sections and Regular Features</title><author><name sortKey="Allen, B" sort="Allen, B" uniqKey="Allen B" first="B." last="Allen">B. Allen</name><affiliation wicri:level="2"><country xml:lang="fr">États-Unis</country><wicri:regionArea>The iSchool at Drexel University, 3141 Chestnut Street, 19104, Philadelphia, PA</wicri:regionArea><placeName><region type="state">Pennsylvanie</region></placeName></affiliation><affiliation wicri:level="1"><country wicri:rule="url">États-Unis</country></affiliation></author><author><name sortKey="Hall, Catherine" sort="Hall, Catherine" uniqKey="Hall C" first="Catherine" last="Hall">Catherine Hall</name><affiliation wicri:level="2"><country xml:lang="fr">États-Unis</country><wicri:regionArea>The iSchool at Drexel University, 3141 Chestnut Street, 19104, Philadelphia, PA</wicri:regionArea><placeName><region type="state">Pennsylvanie</region></placeName></affiliation><affiliation wicri:level="1"><country wicri:rule="url">États-Unis</country></affiliation></author></analytic><monogr></monogr><series><title level="s">Lecture Notes in Computer Science</title><imprint><date>2010</date></imprint><idno type="ISSN">0302-9743</idno><idno type="eISSN">1611-3349</idno><idno type="ISSN">0302-9743</idno></series><idno type="istex">54E3C4788CBEAF0EDBB52BD7A78672CDB1652F13</idno><idno type="DOI">10.1007/978-3-642-13654-2_11</idno><idno type="ChapterID">11</idno><idno type="ChapterID">Chap11</idno></biblStruct></sourceDesc><seriesStmt><idno type="ISSN">0302-9743</idno></seriesStmt></fileDesc><profileDesc><textClass></textClass><langUsage><language ident="en">en</language></langUsage></profileDesc></teiHeader><front><div type="abstract" xml:lang="en">Abstract: Millions of pages of historical newspapers have been digitized but in most cases access to these are supported by only basic search services. We are exploring interactive services for these collections which would be useful for supporting access, including automatic categorization of articles. Such categorization is difficult because of the uneven quality of the OCR text, but there are many clues which can be useful for improving the accuracy of the categorization. Here, we describe observations of several historical newspapers to determine the characteristics of sections. We then explore how to automatically identify those sections and how to detect serialized feature articles which are repeated across days and weeks. The goal is not the introduction of new algorithms but the development of practical and robust techniques. For both analyses we find substantial success for some categories and articles, but others prove very difficult.</div></front></TEI><affiliations><list><country><li>États-Unis</li></country><region><li>Pennsylvanie</li></region></list><tree><country name="États-Unis"><region name="Pennsylvanie"><name sortKey="Allen, B" sort="Allen, B" uniqKey="Allen B" first="B." last="Allen">B. Allen</name></region><name sortKey="Allen, B" sort="Allen, B" uniqKey="Allen B" first="B." last="Allen">B. Allen</name><name sortKey="Hall, Catherine" sort="Hall, Catherine" uniqKey="Hall C" first="Catherine" last="Hall">Catherine Hall</name><name sortKey="Hall, Catherine" sort="Hall, Catherine" uniqKey="Hall C" first="Catherine" last="Hall">Catherine Hall</name></country></tree></affiliations></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/OcrV1/Data/Main/Exploration
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000743 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd -nk 000743 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Ticri/CIDE
|area= OcrV1
|flux= Main
|étape= Exploration
|type= RBID
|clé= ISTEX:54E3C4788CBEAF0EDBB52BD7A78672CDB1652F13
|texte= Automated Processing of Digitized Historical Newspapers beyond the Article Level: Sections and Regular Features
}}
| This area was generated with Dilib version V0.6.32. |  |